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U.5  AIR  FORCE 


Abstract 


Rapid  Improvement  Team  (RIT)  and  Evolutionary  Acquisition 
Decision  Review  (EADR)  process.  Outline  the  RIT  initiative  as  an 
OSD  sponsored  program  to  use  evolutionary  acquisition  to  get  IT 
capabilities  to  the  warfighter  faster.  RIT  moves  large  software 
intensive  programs  from  "Oversight"  to  "Insight"  transforming 
the  way  we  think  about  how  to  satisfy  statutory  and  regulatory 
acquisition  requirements  without  impacting  or  stalling  programs 
that  would  provide  sorely  needed  mission  capabilities.  GTN  21  is 
the  first  of  the  RIT  programs  to  successfully  pass  an  EADR  that 
gives  the  equivalent  of  a  MS  B  decision.  This  precedent  setting 
event  included  much  discussion  about  how  to  shift  the  burden 
off  proof  of  compliance  on  the  part  of  the  program  office 
"oversight"  to  the  burden  of  review  and  facilitation  on  the  part  of 
the  OSD  and  Service  stakeholders  "insight". 
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Overview 

U.S.AIR  FORCE 

n  Rapid  Improvement  Team  (RIT)  Initiative 
Defined 

n  GTN  21  Overview 
n  GTN  21  Lessons  Learned 
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The  Traditional  Acquisition 

Process  Timelines 
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U  S. AIR  FORCE 


Today:  Oversight  Process  That  M 
Exceeds  IT  Innovation  Cycle 
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TYPICAL  A/C  SYSTEM 
LIFE  CYCLE 
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RIT  Tasking 


n  “Information  Technology  (IT)  is  a  key  enabler  for  transforming 
military,  business,  and  administrative  processes  to  meet  the 
challenges  of  the  21st  Century.  To  achieve  these  objectives,  we 
must  strive  to  reduce  the  cycle  time  to  deliver  mission  effective  IT 
capabilities  to  18  months  or  less” 

n  “...the  DoD  CIO,  USD(AT&L),  USD(C),  and  VCJCS  are  co¬ 
sponsoring  a  Rapid  Improvement  Team  (RIT)  to  address  this 

reduction  in  the  time  to  deliver  IT  mission  capabilities  and  improve 
mission  effectiveness  and  efficiency  ” 

n  “We  have  directed  the  co-chairs  to  manage  this  RIT  initiative  and 
report  its  ...recommendations  to  us  not  later  than  October  2001.” 

USD(AT&L)  and  ASD(C3I)  Memo,  2  August  2001 
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RIT  Organization  Structure 


J0/ 


5  Original  Teams 
Have  Identified 
Recommendations 
in  Thrust  Areas 


New  Structure 
Focuses  on  the  End- 
to-End  Process 
and  Implementation 
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IT  RIT  Executive  Council 


Sponsors: 
n  Mr.  Aldridge  (AT&L) 
n  Mr.  Lanzilotta  (Comptroller) 
Joint  Chairs: 

n  Dr.  Margaret  Myers  (DCIO) 
n  Mr.  Bob  Nemetz  (AT&L) 
Principals: 

n  Mr.  Dave  Borland  (Army  DCIO) 
n  Mr.  Ron  Turner  (Navy  DCIO) 
n  Mr.  John  Gilligan  (AF  CIO) 

n  Ms.  Diane  McCoy  (DISA) 
(AFPEO/CS&CS) 

n  Mr.  Bill  Curtis  (DCIO) 
n  BG  Charles  Croom  (J-6) 


Mr.  Stenbit  (C3I/CIO) 

LTGEN.  Carlson  (J8) 

Mr.  Ron  Garant  (Comptroller) 
ADM  Stanley  Szemborski  (J-8) 

Mr.  John  Landon  (C3ISR  OIPT) 
Mr.  Dale  Uhler  (DASN) 

Mr  George  Wauer  (DOT&E) 

Mrs  Virginia  Williamson 

Mr.  John  Osterholz  (DCIO) 

COL  Mike  Perrin  (J-8) 
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Overarching  Goal 

Reduce  cycle  time  to  deliver 

mission  effective  IT  capabilities 

j  to  1 8  months  or  less 
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RIT  Pilot  Major  Thrusts 


n  Risk-Balanced  Oversight  -  The  allocation  of 
appropriate  supervision  and  oversight  resources 
consistent  with: 
n  The  risks  of  the  investment  and; 

n  The  goal  to  manage  and  oversee  programs  at  the  lowest 
competent  and  capable  level. 

n  Doc  X  -  The  sum  of  information  needed  to  enable 
a  decision  maker  to  set  the  program  on  a  given 
acquisition  path  with  a  defined  level  of  oversight 
appropriate  to  the  risk  involved 

n  Information  -  Utilize  an  information-based  portal 
providing  real-time  visibility  of  IT  programs  in  a 
joint/shared,  secure  database  open  to  the 
community  to  pull  from  to  do  their  job 


Integrity-  Service-  Excellence 


11 


V 


U  S. AIR  FORCE 


IT  Spiral  Development  & 
Acquisition  Process  Cycles 
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Our  Goal:  More  Timely 
Knowledge  &  Less  Control 
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Control 


The  RIT  Pilot  will  utilize  the  Army’s 
Acquisition  Portal  and  the  EADR  process 
to  move  us  from  oversight  to  insight. 
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Evolutionary  Acquisition  Decision  Review  , 


(EADR)  Process  Objectives 


n  EADR  process  objectives 

n  Establish  an  agile  acquisition  process  involving 
strong  Customer  and  PEO  participation  (and  OSD 
where  appropriate) 

n  Allocates  funds  that  are  aligned  with  operator  prioritized 
requirements 

n  Aligns  oversight  process  with  spiral  development  strategy 

n  Delivers  functional  capability  within  the  customer’s  current 
funding  envelope 

n  Establish  a  responsive  and  disciplined 
requirements  process 

n  Retains  corporate  ability  to  make  timely  decisions  and  change 
direction  as  required 
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Evolutionary  Acquisition  Decision  Review 
(EADR)  Process  Objectives  (continued) 


n  EADR  process  objectives  (continued) 


n  Align  program  documentation  and  performance 
metrics  to  IT  Spirals 

n  Identify  the  management  infrastructure  to 
manage  program  and  incremental  spirals 

n  Processes,  tools,  and  manpower 

n  Satisfy  DoDI  5000.2  mandates  and  applicable 
EA  AFIs/Ols 


n  Across  spirals  at  various  stages  of  acquisition 
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IT  RIT  Process 


“As-Is”  IT 
Acquisition 
Process 


•  Assess  &  Benchmark 

Current  Performance 

•  Quantify  Impact  of  Proposed 

Changes  on  Time  /  Quality 

•  Pilot/Test  (only  if  necessary) 

•  Gain  Buy-in  &  Approval 

•  Vet  Change/  Resolve  Issues 
•Change  Policies  &  Practices 

•  Issue  Guidance 

•  Provide  or  Ensure  Training 

•  Become  “Change  Agents” 

—  New  Culture,  Rewards 


RIT 
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Validate  Ideas 
Generate  New  Ideas 

Other  Sources: 


Plan  Implementation, 
Integration  & 
Measure  Results 


Implement  Changes 


Industry  Best  Practices 

Independent  Review 
Team 

•  Define  Changes  for  Execution 

•  Prioritize  and  Phase  Changes 

•  Build  Schedule/  Deliverables 

•  Define  Resources  (Id.  Gaps) 

•  Identify  Change  Leads 

•  Integrate  Changes  in  Process 

•  Measure/Report  Benefits 


“To-Be”  IT 
Acquisition 
Process 
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Focus  of  IT  RIT  Activities 


n  Innovation,  agility  and  speed  to  meet  emerging 
threats  --  e.g.,  Homeland  Defense 

n  Delivery  of  mission-effective  IT  capabilities  to  the 
warfighter  within  threat  /  technology  cycle  times 

n  Shift  to  risk-based  oversight  with  reduced  burden 
and  staffing 

n  Delegate  responsibility  and  accountability  to 
lowest  levels  -  process  owners  &  developers 

n  Establish  improved  DoD  “End-To-End”  IT 

Acquisition,  Management  and  Oversight  Policies 
and  Processes  that  rapidly  deliver  mission 
effective  IT  capabilities  to  the  warfighter  and 
other  users 
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Summary  M 


n 


n 


n 


IT  RIT  developed  set  of  recommendations  focused  on 
reducing  acquisition  cycle  time  and  improving 
effectiveness 

Integration  of  recommendations  with  the  current  “As-ls” 
system  (RGS,  PPBS  and  AMS)  underway 

RIT  restructured  for  implementation  and  risk  mitigation 
n  Implementation/Integration  Team 
n  Pilot  Team 

n  New  Concepts  Exploration/Experimentation 

Positioned  for  near-  and  mid-term  change 

n  Fix  long-standing  problems  in  near-term,  position  for  “radical” 
change 

n  Pilot  and  explore  new  ideas  to  feed  the  new  process 
n  Evolve  to  a  ”To-Be”  new  way  of  doing  business  (mid-  to  long- 


n 


n 


n 


term) 
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Pilot  Candidates 
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M  -  GCSS-AF,  ILS-S,  IMDS,  SCS,  GTN21, 
FIRST 

NAVY  -  NAVSEA  (ERP)-  NEMAIS, 
NTCSS,  GCSS-M 

ARMY  -  TC-AIMS  II 

PISA-  GCSS(CINC/JTF) 

Health  Affairs  -  Systems  TBD 
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Pilot  Program  M 
Oversight  Approaches 


n 


n 


n 


n 


n 


AF  (GCSS-AF,  ILS-S,  IMDS,  SCS,  FIRST,  GTN-21) 
n  EADR  (Evolutionary  Acquisition  Development  Review) 
n  Decision  Authority  -  PEO-  Brig  Gen  (sel)  Dehnert  /Ms  Williamson 
Health  Affairs  (TMIP) 

n  Capitalize  on  existing  MHS  IM/IT  program  governance 
n  Decision  Authority  -  ASD  (Health  Affairs)  -  Dr.  Winkenwerder 
DISA  (GCSS-CC/JTF) 

n  Periodic  reviews  to  monitor  progress  following  initial  program  review 
n  Decision  Authority  -  Principal  Director  -  Ms  McCoy 
Army  (TC-AIMS-II) 

n  Draft  DA  acquisition  process  for  RIT  Pilot 
n  Decision  Authority  -  ASD  (C3I)  -  Mr.  Stenbit 
Navy  (NTCSS) 

n  Virtual  Oversight  thru  use  of  portal  for  decisions 
n  Decision  Authority  -  DASN(C4l/EW/Space)  -  Dr.  Uhler 


n 


n 


n 


n 


n 
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RIT  Pilot  Phases  & 

Milestones 


Jan  02  Phase  1  Jun  ^ 
Organization 


WE 

ARE 

HERE 


Dec  03  Mar  04 


•Pilot  Formulation 

•  Pilot  Team  Formed 

•  Pilot  Projects  Status  Updated 

•  Recommendations  Reviewed 

•  Component  Oversight 
Clarified 

•Risk-balanced  Oversight 

•  Risk  Radar,  P/C/S 

•  SW  Acquisition  Capability 

•  Metrics  Selected 

•Portal  Approach  Formulated 

•  Army  AIM 

•  Air  Force  SMART 

•  DAU  PMCoP 


Phase  2 
Execution 


•Implement  Pilot  Process 

•  Component  Decision  Process 

•  PEO/PMO  Risk  Management 

•  SW  Acquisition  Capability 

•  Observe  Component  Decision 
Process 

•  Portal-based  RIT  Team  Insight 

•  Move  to  information-based 
insight 


Phase  3 
Evaluation 


•  Final  RIT  Pilot 

Report 

•  Blueprint  for  IT 
Acquisition 


•Implement  a  DoD  IT/NSS  CoP 
•To  share  Pilot  information  with 
the  entire  IT  community 
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Overview 

U.S.AIR  FORCE 

n  Rapid  Improvement  Team  (RIT)  Initiative 
Defined 

n  GTN  21  Overview 
n  GTN  21  Lessons  Learned 
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Vision 

U.S.AIR  FORCE 

To  gather  the  family  of  transportation 
customers  and  providers  of  lift  into  an 
integrated  Defense  Transportation  System 
(DTS)  data  infrastructure  that  will  provide  the 
Intransit  Visibility  (ITV)  and  the  C2  decision 
support  information  necessary  to  meet 
customer  requirements. 
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Mission 


n  The  Mission 

n  Provide  near-real  time  visibility... 

n  Global,  multi-modal  movement 
n  Passengers,  Cargo,  Patients 
n  Peace,  War,  Contingencies 

n  Provide  the  Warfighter  with  C2 
Decision  Support  Capabilities 
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Concept 


DoD,  Service,  &  Commercial 

Interfaces:  A 

-  AIR  Ops  - 

-  LAND  Ops 

-  SEA  Ops 
-UNIT 

-  SUPPLY 

-  COMMAND  &  CONTROL 


ITV 


Classified  -  Secret 
Unclassified  -  Sensitive/Protected 


DTS  Customers 
Deploying  Units 
Materiel  Mgrs 
TMOs/ITOs 
Depots 
Service  HQs 
Systems 


Command  Centers 


Operators 

Planners 

Logisticians 
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Replacement  System 

Strategy 


n  Shortcomings  in  Current  GTN  System 

n  Does  not  satisfy  all  ORD  requirements 
n  Obsolete  technology 
n  Replacement  strategy  chosen 

n  Full  and  Open  Competition,  Best  Value 

n  Competition  critical  for  innovation,  quality  and 
affordability 

n  Allows  current  technology  insertion 
n  Will  satisfy  all  ORD  requirements 
n  Significant  lessons  learned  from  current  program 
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A 


Acquisition  Strategy 


Designated 
RIT  Pilot 


FY01  -  FY02 


j^2nc 


2nd  Qtr  FY02 


Acquisition 

Strategy 

Formulation 


Industry  Days  (5) 
One-on-Ones  (40+ 
Web  Accessible 
Info 
RFI 

Sources  Sought 
Draft  RFPs 
RFP  Release 


3rd  Qtr  FY02 


Phase  I 

Source 

Selection 


•  Evaluate  Proposals 

•  Written 

•  Oral  (In-Plant) 

•  Interim  Ratings 

•  SSA  Rebuttal 

•  Discussions 


4th  Qtr  FY02 


Phase  II 
Down  Select 

Deliverables: 

•  DBDD 

•  Technical  Approach 

•  IMP/I  MS 


•  Development 

•  Operations 

•  Maintenance 
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Two-Phase  Approach 


n  Two  Phase  Approach 
n  Phase  I  -  Risk  Mitigation  &  Data  Gathering 

n  Firm  Fixed  Price 

n  At  least  2  contracts  -  $2M  per  contract  * 
n  4-Month  Period  of  Performance 
n  Deliverables 

n  Tailored  Database  Design  Document  (DBDD) 
n  Integrated  Master  Schedule  (IMS) 
n  Technical  Approach  &  Integrated  Master  Plan  (IMP) 

n  Cost  Proposal  received  after  tech  eval  completed 

*  Award  made  to  Northrop  Grumman  Information  Technologies,  TRW,  CSC,  and  Harris 
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n  Phase  II  -  Development  and  O&M  (up  to  16 
years) 

n  Cost  Plus  Award  Fee 

n  Exercise  Option  on  single  Phase  I  Contract 

n  3-Year  Development  to  IOC 

n  2-Year  Development  to  FOC 

n  2  Years  O&M  Between  IOC  &  FOC 

n  1-Year  Follow-on  O&M  Post  FOC 

n  10-Year  Follow-on  Maintenance 

n  Actual  Durations  Depend  on  Proposed  Schedule 
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Program  Management 


-^^TION  °°  ' 


ASD(C3I) 

SAF 

/AQ 

System  Program 
Director  (SPD) 
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USTRANSCOM 

Stakeholders 
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System  Characteristics 


n  Hardware:  COTS 
n  Software:  COTS  &  Developed 
n  Primary  Site:  Scott  AFB 
n  Alternate  Site:  DECC  STL 
n  User  Interface:  Web-Based — No  Deployed  Code 
n  Large  Database 
n  Multiple  Interfaces 

n  Aggregate  Data  from  many  sources 
n  No  direct  data  input 

n  Supply  aggregated  data  to  end  users/customer  systems 
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Overview 

U.S.AIR  FORCE 

n  Rapid  Improvement  Team  (RIT)  Initiative 
Defined 

n  GTN  21  Overview 
n  GTN  21  Lessons  Learned 
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Acquisition  Streamlining 

(RIT) 


n  Oversight  as  exception  processing 

n  Continuous  access  to  info  for  comment  vice 
shepherd  through  long  approval  process 

n  Post  to  AIM  (Doc  X) 

n  Periodic  Evolutionary  Acquisition  Decision 
Reviews  (EADRs)  replace  formal  milestones 

n  Establish  18  month  max  delivery  cycle 

n  Designated  GTN  21  from  ACAT  1AM  to  1AC 

n  MDA  lowest  appropriate  level  (AFPEO/C2&CS) 


Integrity-  Service-  Excellence 


35 


V 


U  S. AIR  FORCE 


Proposed  IT  EADR 

Example: 


Nov  99  EADR1 


EADR  2 


n  1 

i 

i 

Mar 

02 

6  Months 

7 

Sep 

02 


In-Process 
Review 

12  Months 


EADR  3 


EADR 


Approved: 

-  What  are  we  buying? 

--  Requirements 

-  How  are  we  buying  it? 
--  Funding 

--  Acquisition  approach 
--  EADR  Approach 

-  What  are  the  risks? 

--  Risk  ID  complete 

Documentation 

-  MNS 

-  Draft  ORD  (w / 
Interoperability  KPP) 


Contract 

Award 


Approved: 

-  What  are  we  buying? 

--  Requirements 

-  How  are  we  buying  it? 

--  Funding 

--  Acquisition  approach 

-  What  are  the  risks? 

--  Mitigation  Plans  complete 
--  Incentive  Plan 

Documentation 

-  Doc  X 

--  Evol  Pgm  Baseline 
Yearl:  Baselined 
Yrs  2-8:  Forecast 


Sep 

03 


12  Months 


04 


Deliver  Spiral  1 

Exit  Criteria 


Approved: 

-  What  are  we  buying? 

-  How  are  we  buying  it? 

-  What  are  the  risks? 

DocX 

-  Evol  Pgm  Baseline 
Year  2:  Baselined 
Yrs  3-9:  Forecast 

-  Updates 


r  ■ 
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Senior  Official  Involvement  Critical  to  Success 
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A 


Key  Stakeholders 
involved  (VTC) 


DR  Participants 


n 


n 


n 


MDA: 


n 


Deputy  AFPEO  (C2&CS), 

Co-Chair 


n 


n 


User: 

TCJ3/4,  Co-Chair 
JSJ4 

CIO: 

TCJ6,  Co-Chair 
AFCIO  CD 
DASD(C4ISR) 


Decision  Authority 
and  Customers  as 
Co-Chairs 


C3 


n 


n 


n 


n 


n 


n 


n 


n 


Test 

OSD(T&E) 

AF/TE 
AFOTEC 

Budget/Cost: 

TCJ8 

OSD  Comptroller 
SAF/FMC 
AFCAA 

Acquisition: 

SAF/AQC/AQI/GCQ 
AFMC/DR 


n 


n 


n 


n 


n 


n 


n 


\y 

ervice-  Excellence 

37 


V 
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▲ 


GTN  21  EADR  Outline 


n  What  Are  We  Buying? 

n  How  Are  We  Buying  It? 

n  What  Are  the  Risks? 

n  Clinger-Cohen  Act 
Compliance 

T  est  Strategy 

Security  Strategy 

n  Documentation 

n  Summary/Recommendation 
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n 


Mapped  goals  of 
the  EADR  with 
MS  B 

requirements  in 
DODI  5000.2 

Tailored  to 
Program  Needs 

Evidence  of 
total  compliance 
posted  on  AIM 
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RIT  Lessons  Learned  for 

GTN21 


n  Designation  From  1AM  to  1AC  Effects 

n  MDA  Has  Day-to-Day  Knowledge  of  Program 
n  Streamlined  CCA  Confirmation 
n  OSD  Gray  Beards  Still  on  Board 

n  Teaming  with  Key  Stakeholders 
Throughout  Acquisition  Process 

n  Test  IPT  Critical  to  Successful  Test  Strategy 
n  CCA  IPT  Resolved  GTN  21  Unique  Situation 
n  C4ISP  Not  Affected  by  RIT  - 18  Month  Process 
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RIT  Lessons  Learned  for 


A 


GTN  21  (cont.) 


n  EADR  Minutes  Serve  as  ADM,  Streamlines 
Approval — Reduces  cycle  time 

n  User  Involvement  Still  Critical  to  Success 

n  Author  CCA  Compliance  Items  (I.E.  BPR,  MPMs) 
n  Author  and  Coordinate  MNS,  AoA,  ORD 
n  Participate  in  SAMP,  TRD,  RFP,  C4ISP 

n  Change  From  Oversight  to  Insight  with 
Expert  Help  Another  Key 

n  Initiative  Sharing  -  Information  Pull  Vs. 
Document  Push 

n  MPT  Was  First  Step;  RIT  Takes  It  Rest  of  the  Way 


Integrity-  Service-  Excellence 
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U.5  AIR  FORCE 


RIT  Lessons  Learned  for 

GTN  21  (cont.) 


n  Document  X  (AIM) 

n  Central  Repository  for  Stakeholders  to  Pull  All 
Program  Information 

n  Initial  Move  From  Document  Focus  to 
Information  Focus 

n  Need  a  program  information  structure  upon 
which  to  build  common  repository 

n  Define  views  for  communities  of  interest 


n  Pre-brief  to  EADR  Co-chairs  and 
Information  Flow  Prior  to  EADR  Helped 
Set  Expectations 


Integrity-  Service-  Excellence 


Recommendations 

U.S.AIR  FORCE 

n  Delegate  MDA  to  Lowest  Appropriate  Level 
n  Use  EADRs  for  All  IT  Programs 
n  Continue  to  Foster  Culture 

n  From  Oversight  to  Insight 
n  Information  Pull  vs.  Document  Push 
n  Signature/approval  process  not  there  yet 

n  C4ISP  Process  Too  Long  -  Integrate  with  Doc  X 
n  Document  X  vs.  myriad  program  documents 

n  Build  common  common  program  information  repository 
n  Provide  views  for  communities  of  interest  (i.e.  C4ISP) 

n  MPT  Still  Needed,  but  Facilitated  by  AIM 

n  Align  Financial  Management  Process  (AFCAIG) 
with  EADRs 


Integrity-  Service-  Excellence 
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Abbreviations 


A/C  -  Aircraft 

AFI  -  Air  Force  Instruction 

AFPE0/C2&CS  -  Air  Force  Program  Executive  Officer  for 
Command  Control  &  Combat  Support 

AOA  -Analysis  of  Alternatives 
APB  -  Acquisition  Program  Baseline 

ASD(C3I)  -  Assistant  Secretary  of  Defense  for  Command 
Control  Communications  and  Intelligence 

C2  -  Command  and  Control 

CAIV  -  Cost  as  an  Independent  Variable 

CINC  -  Commander  in  Chief 

CONOPS  -  Concept  of  Operations 

CRD  -  Capstone  Requirements  Document 

DAB  -  Defense  Acquisition  Board 

DoDI  -  Department  of  Defense  Instruction 

USD(AT&L)  -  Under  Secretary  of  Defense  for  Acquisition 
Technology  and  Logistics 
EA  -  Evolutionary  Acquisition 
EADR  -  Evolutionary  Acquisition  Decision  Review 
Evol  -  Evolutionary 
FoS  -  Family  of  Systems 
FOC  -  Full  Operational  Capability 
IOC  -  Initial  Operational  Capability 


ISC2  -  Intelligence  Surveillance  Command  and  Control 

IT  -  Information  Technology 

JROC  -  Joint  Requirements  Oversight  Council 

KPP  -  Key  Performance  Parameter 

MOB  -  Mission  Operations  Board 

MDAP  -  Major  Defense  Acquisition  Program 

MNS  -  Mission  Need  Statement 

N/UWSS  -  NORAD/USSPACECOM  Warfighting  Support 
System 

OAB  -  Operations  Approval  Board 

01  -  Operating  Instruction 

O&M  -  Operations  and  Maintenance 

ORD  -  Operational  Requirements  Document 

OSD  -  Office  of  the  Secretary  of  Defense 

PEO  -  Program  Executive  Officer 

Pgm  -  Program 

PPBS  -  Planning,  Programming,  and  Budgeting  System 

RDT&E  -  Research,  Development,  Test  and  Evaluation 

RFP  -  Request  for  Proposal 

SAMP  -  Single  Acquisition  Management  Plan 

TEMP  -  Test  and  Evaluation  Master  Plan 
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